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A  FOtvtAL  DEOUCnVE  PR032.E  '-SOLVING  SY5IT!'1 

jc  R.  QuieLa®  sod  E,  B,  bust 

S!»e  Sfeibatsity  o £  H»sh£#gt®s 

1.1  i&tivatifflia  Computer  programs  which  solve  ntoblem  have  excited 
considerable  interest,  Two  lines  of  research  have  bees  followed,  In  one, 
deductive  theorems  ate  translated  into  statements  in  a  firat-erdar  theory,  and 
a  first-order  proof  sought.  The  work  of  J.  A.  Robinson  (10)  e-sen?  lilies  this 
approach .  An  alternative  procedure  is  to  represent  s  deductive  srob A&m  as  s 
f  giblem  of  finding  permissible  r«;nJng  rules  which  perirlfc  on&  to  go  from  a 
string  of  symbols  describing  the  initial  state  to  e  string  of  syr&cls  describing 
the  goal  state.  The  "General  Problem  solver"  (GPS)  of  Met/ell,  Shew  an,'  Simon, 
(7,8),  although  not  originally  presented  in  these  terras,  is  m  example  of  this 
sort  of  program. 

The  internal  operation,  of  the  GPS-like  theorem  provere  resembles  the 
syntactic  phase  of  a  compiler,  in  that  prediction  rules  are  applied  to  change 
sentences  from  one  form  to  another. 

In  this  paper,  ”e  shall  present  a  formal  description  of  e  class  o£ 
problem-solving  programs  of  the  compiler -like  variety.  It  will  specify  a  class 
of  recursive  programs  quite  similar  to  cop-dam'1  compiler-compilers.,  '/e  oils'  1 
then  shot-;  that  there  is  a  clasj  of  problems  which  such  prorrans  cannot  solve. 

Next  we  describe  a  edified  structure  'ditch  generates  more  powerful  program'', 

These  are  non-recursive  programs  which  destroy  their  similarity  to  a  eonollor- 
compiler. 

Our  irork  was  originally  motivated  by  descriptions  of  the  GPS,  and  we 
acknowledge  our  Intellectual  debt  to  Jewell  and  his  co-workers,  "e  have  proceeded 
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Ivi  a  soncwhnt  different  direction,  however,  and  our  present  system  should  not  be 
regarded  as  a  formalieation  of  GPS.  ”:o  shall  return  to  the  point  after  presenting 
ov.v  system,  Program:  generated  within  cut  ays  ten  have  been  written  in  Algol  and 
FORTRAN  IV,  cr.cl  have  been  use .1  to  solve  reasonably  difficult  probiers.  Some 
'examples  will  be  presented. 

1.2  Gercval  Description:  States  ire  represented  by  strings  of 
symbols .  Strings  obeyin'’  certain  rules  for  permissible  sequences  of  symbols 
are  called  structures ,  or  well  formed  expressions .  A  state  is  always  represented 
by  a  structure .  Structures  nay  contain  substructures .  The  syT  hols  of  a  string 
ere  drawn  iron  a  infinite,  countable  set  of  symbols  called  alphabet . 

A  transformation  writes  one  well  touted  expression  into  another.  A 
problem  ie  solved  wh  a  a  sequence  of  transformations  is  found  that  writes  the 
starting  state  into  the  goal  state. 

2.  Definitions 

2.1  Alphabet :  The  alphabet,  a_  ,  is  an  infinite,  countable  set 
of  symbols  formed  bv  the  union  of  n  finite  set  X  of  teminnl  symbols  and  an 
infinite,,  countable  wet  V  of  non-terminal  symbols. 

.1,2  Terminal  Symbols;  The  set  of  terminal  symbols  T  ,  is  the  union 

/w 

of  k  finite  ceto  T  ot  terminal  symbols  of  degree  i  .  That,  is, 

_ 

1  »  U  Tt  ,1=0,  ...P-1 

where,  if  </)  is  the  empty  set, 

A  n  li.-*  ,f  i-'i' 

i’.xarjple :  In  elementary  algebra,  T  would  consist  of  the  set  of  bound 

variable  symbols  (a,  b_,  c,  etc.)  ,  the  set  Tj  containing  unary  minus ,  and  *-he 

set  .,r  binary  connectives  {+  ,  -  ,  x  ,  /  ,  +  }  . 
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2.3  don- Terminal  Symbols :  The  set  V  consists  of  the  infinite 

countable  set  of  symbols  {V^  }  >  0}  ,  vhich  denote  free  variables . 

2.4  Terminal  Closes:  Let  C  *-  {C^ ,  1  0 »  . . .  n  -  1 }  be  a  set  of 

sets  of  terminal  symbols s  such  ch’’t 

(i)  all  the  i 'aments  in  C  are  of  tha  sane  decree  for  all  values 
of  i  t  and 

Cil)  everv  te,..jinal  symbol  is  in  at  least  one  . 

2.3  Structures  (nail  forced  oxr-ressions) :  ell  formed  expressions 

are  defined  by  the  following  rules: 

A  variable  symbol  is  a  s)«j expression. 

2.5.2:  A  terminal  symbol  of  decree  n  followed  t>y  n  uell  formed 
expressions  is  a  well  formed  expression. 

Tills  is  simply  the  prefix  or  ’Polish1'  notation.  It  is  obviously 
isonomhlc  to  a  tree  graph. 


Halations  between  structures: 

^•1  Terras  describing  strings  and  substrings:  Let  s  be  a  string 

of  symbols  ^q*  ^*2*  '  *  *  *  ^i*  *  ‘ *  ^n~l  * 

3.1.1:  The  length  of  s  (L(s))  is  n  . 

3.1.2:  The  symbol  is  the  symbol  in  position  i  of  s_  ,  starting 

i*ith  s, j  - 

3.1.3:  If  s  is  a  structure,  s(i)  is  the  veil  forrx  :  expression 

(substructure)  beginMn«*  mith  symbol  s 

*■ 

3.2  Concatenation:  Let  and  s^_  bo  strings,  s  is  a 

concatenation  of  sa  and  s?  if 


(1)  s  -  sj,  sa. 


a  b 

Vr  V 


i  ’ 


V-l 


wtu.re  I.(s  ) 


»  n  and  L(o  ) 

(.2)  8  •  a9  S^ 


in.  This  is  written 


3,  i  Pirect  components .  'or  an;  structure  s(i )  ,  let  " ( s  ( i) }  -- 

s(l  +  L(s (1) ) )  j  i.e. ,  the  structure  ii /•ediately  following  g(l)  In  s_  - 

2 

(s (i) )  is  the  following  structure  of  s(j  )  ,  rf-ilarly  •  ( s  ( i ) )  in  the 

following  structure  of  the  following,  structure  of  s  (j )  .  Let  s  -  be  a  symbol 

of  decree  n  .  The  direct  components  of  s^  ^  art  sjj)_  »  '  ( s  ( j ) )  ,  h,n  (a  ( 1 ) )  . 

3.4  Equivalence .  T'o  strings  s  and  t  are  enul^al^nt  if  L(s)  = 

L(t)  ..  and  for  tvury  1  ,  0  <_  i_  <  L(s)  ,  either 

(a)  3 ^  *=  =  V,  for  some  j_  ,  or 

vo;  s,  ,  t.  k  e,  foi  some  k  . 

i  i  __k  ~ 

3.5  Substitution :  The  value  of  the  function  B(V  ,  u  ,  s)  is 
define4  as  the  string  which  results  from  replacing  each  occurrence  of  the  symbol 
V  in  the  string  £  with  the  well  formed  expression  u  .  Hie  rule  of 
substitution  states  that  a  structure  s  may  he  replaced  bv  the  structure 

B(V^,,  u,  s)  for  any  and  any  well  formed  expression  u  . 

3.6  Specification :  A  string  s  is  a  specification  of  a  string 

t  (written  s  t  )  if  there  is  set  of  oairr.  {(V  ,  u  )  ,  j  =  1,  n }  such 

*•  j  ...  J- 

that  the  strings  s  ant 

B(V  ,  u  ,  B  ( V  ,  u  ,  u  t)  ...)))  are  equivalent . 

1  n  *  l  ,  r.-l  —  (  ,  I 

J!  —  n  L -  ! 

Comment :  In  the  degenerate  c  »se,  equivalence  one  specification  apnlv  to 
symbols . 

3.7  Correspondence  Given  two  strings  £  and  y  ,  the  correspondence 
relation  C  between  their  symbols  is  defined  as  folio* : 


(a)  g  g  (s^  corresponds  to  c^'i 


O'* 


(b)  a.  C  r,  if  there  exist  i’ 
j  k  ^ 

U)  ,  c  ,k 


SUCh  that 


(i")  a  S  rk.  ,  and 
(iii)  s(j) ,  q(k)  are  the  if  direct 

components  of  Sj  *  ’  "j- •  >  respectively. 


4 ,  Rewriting  rules  and  operators: 

4.1  Oetalinoulstlc  symbol  "  :  The  metalinguistic  symbol  ’ 

is  defined  to  mean  "may  be  rewritten  as'  ,  The  statement  £  :*  is  interpreted 
as  "structure  s  may  be  rewritten  as  structure  £*  ’  , 

4.2  Rewriting  rules;  Let  Z^  and  r^  be  structures.  Hie  rule 

;■  r.  is  tinp  rule  R  . 

_i  JL  ~L 

4.3  Application  of  rewriting  rules:  Let  £  be  a  structure,  and  n 

a  rewriting  rule.  The  application  of  R^  to  £  ,  written  P^(s)  ,  is  defined  by 

(a)  if  s  is  not  a  specification  of  Z ^  ,  R^ (£)  is  undefined. 

(b)  if  £  is  a  specification  of  Z^  ,  let  Z.  be  the  sequence 

of  substitutions  which  transforms  Z^  Into  a  string  equivalent  to 
£  -  i.e. ,  s  is  ecu! valent  to  •  Then  (s )  -  Z(Tj )  . 

Exc.rple :  Suppose  R  is  +  v  V.  :«  +  v ,  ,  and  an  attempt  is  made  to  form 

o  (  +  a  +  b  c  )  .  The  required  substitution  sequence  ?■  can  be  defined  i>y 

Z(X  )  £  .  +  b  c  ,  >H\’V  a,  Z1))  +  a  +  H  c  ,  no  j  (  +  a  +  b  c) 

is  defined  as  the  structure 

Z(rj)  £  B(V^  ,  +  b  c  ,  _R(Vj.  *».  r ^ )  ’  1  t  1  L  i  i  • 

4.4  Operators :  An  operator,  0. -  is  apniled  to  structure  s  when 

rewriting  rule  R  is  a,  plied  to  substructure  s  ( |)  of  >  .  Let  k  -  L(o£l}_) , 
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n  »  L(s)  .  Then 

(a)  0i1 (g)  is  undefined  if  a (1 )  is  not  a  specification  of  t ^  • 

<b>  °ij^^  *  S0sl*,,8j-1  8j+k  8j+k+l‘ **8n-l  otherwlse* 

4.5  Analysis  of  the  effects  of  rewriting  rules;  In  order  to  apply  rule 
to  some  structure  £  ,  one  must  find  a  substitution  sequence  Z  which 

satisfies  4.3(b).  The  result  of  applying  the  rewriting  rule  will  be  the  structure 
s*  ■  ZCr^)  .  For  every  symbol  in  r^.  ,  there  will  be  a  symbol  or  a  structure  in 
£*  which  is  a  specification  of  it.  Let  (r^)  ^  be  the  Jth  symbol  in  r^  .  If 
(r^)j  is  a  terminal  symbol,  then  this  symbol  will  appear  in  £*  ,  and  so  one  of  the 
symbols  of  is  therefore  fixed.  If  (r^).  Is  e  non-Lerrainal  symbol,  then  the 

corresponding  structure  of  is  defined  only  in  terms  of  the  symbols  in  s_  . 

In  analyzing  rewriting  rules,  two  tables  can  be  constructed.  One  lists 
the  symbols  of  s*  whose  Identity  is  fixed  regardless  of  the  synbols  in  s.  ,  while 
the  second  table  lists  the  structures  of  s_*  which  are  defined  in  terms  of  s_  .  (In 
effect,  this  is  what  happens.  Actually,  the  structures  of  which  are  defined  in 

terms  of  structures  of  t ^  are  listed.) 

Example:  Consider  the  distributive  law  of  algebra. 


±  £  v!  v2  £  v 3  v2  £  ±  vx  v3  v2  • 

Whenever  this  rule  is  applied,  the  first  symbol  of  the  resulting  structure  is  always 
"x'1  and  the  second  always  .  The  structure  beginning  at  the  third  symbol  will  be 

whatever  structure  began  at  the  symbol  corresponding  to  in  the  left  hand  string, 

and  similarly  for  the  structures  replacing  Vj  and  .  The  results  of  applying 
a  particular  operator  0^  to  string  s.  can  be  determined  by  examining  n(1)  to 
flid  what  the  specifications  of  V^,  Vj  ,  and  are  in  this  case. 


*»*»--  - 
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Coament :  The  tables  defined  by  analyzing  rewriting  rules  play  ehe  same  role  in 
our  formalism  as  do  opera tor-difference  tables  in  the  GPS  (8). 


5.  Problems  defined: 


5.1  Difference  sets:  Let  _s  and  jj  be  two  strings.  The  difference 
set  of  j  and  jg,  E(s,jg),  is  defined  by 

E(s,£)  *  E*(sfJg)  y  EJ  (s,£)f  where 

(a)  A  pair  (g^,  k)  is  a  member  of  E*(s,£)  if 

(1)  .kcgj 

(2)  gj  is  not  a  variable  symbol 

(3)  s^  is  not  a  specification  of  g^ 

(b)  A  pair  (gji»  k’)  *  member  of  E^(s,j$)  if,  for  some  j,k 

(1)  »k  C  gj 

(2)  g  is  a  variable  symbol 

(3)  <gjl,  k')  e  E(s,B(gj,  s(k),  jg)) 

Example:  In  comparing 

o  m  V  V 

-  -  Vl 

js  «  +  ab, 

E(a,jg)  la  formed  in  the  following  steps. 

(a)  The  only  non-variable  symbol  in  ^  is  +  „  The  corresponding 
symbol  in  b  is  also  +  ,  hence  E*(s,g)  *  0  ,  the  null  se 

(b)  Symbol  g^  is  the  variable  symbol  .  The  corresponding  symbol 
in  s  is  a  .  Making  the  substitution 


we  find  E1(s,g)  «  ECSjg1)  . 


B(g1,  8(1),  g)  -  g  ■  +  aa 


(b.l)  By  comparison  of  corresponding  symbols,  the 
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only  mismatch  which  occurs  is  at  position  2,  where  ■  a  ,  a  ■  b  . 
Therefore , 

E*(s,g1)  -  {(a, 2)} 

(b.2)  String  £_  contains  no  variable  symbols,  so 
E^(s,  g^)  *  t  for  all  j  ,  hence 

E(s,  g1)  =  E*(s ,  g1)  *  E1(s ,g)  -  {(a, 2)} 

(c)  Now  consider  ■  V1  ,  the  second  variable  symbol  in  g  .  By 
repeating  the  above  steps,  except  that  we  are  now  concerned  with  g^  instead  of 
g^  ,  we  find  that 

E2(s,g)  -  E(s,g2)  -  {(b.l)} 


(d)  Combining  the  above  steps 


E(s,g)  -  {(a, 2),  <b,l)} 

Comment :  Difference  sets  between  two  strings  are  defined  by  syntactic  considerations 

only.  An  advantage  of  this  is  that  we  can  use  the  same  algorithm  to  generate 

difference  sets  for  any  deductive  system  which  fits  our  formalism.  This  provides 

us  with  a  very  general  theorem  prover ,  which  requires  little  guidance  from  the 

person  using  it.  On  the  other  hand,  this  definition  does  not  include  all  differences 

which  a  person  might  find  between  two  strings. 

5.2  Problems:  Given  two  strings  a  and  £  ,  (the  starting  state  and 

the  goal  state ,  respectively)  a  problem  is  defined  as  the  location  of  a  sequence  of 

operator  applications  which  demonstrate  that  _s  S  j$.  Symbolically,  a  problem  is 

solved  when  an  ordered  set  of  operators  {  0^  },  a  -  l...n  is  found  such  that 

XaJa 


i  j 

n  n 


(0, 


n-l^n- 


.(0 


Va' 


•(0. 


i^C®)  •••)•••))  -  ■ 


and 
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fee  etgpty. 


n  -  O  rj 

equivalent  to  e  .  When  is  produced  ?  ,  p)  will 


a-1. 


The  step  0  ^  (s  )  can  be  a  member  of  Che  sequence  of  steps  In  a 

,  a"  a 

^".1 

P*°©£  «nly  if  s  (j  )  is  a  specification  of  i,  ,  In  section  4.5  we  noted 

§  J, 

_  a 

that  the  right  hand  string  of  a  rewriting  rale  described  its  results.  By  the 

®bsvs  nrgmant,  we  now  note  that  the  left  hand  string  establishes  conditions  upon 

a  structure  to  which  the  rewriting  rule  can  be  applied.  These  conditions  are 

defined  collectively  by  saying  that  the  structure  must  be  a  specification  of  thd 

left  hand  string  of  the  rule.  If  F,{g  (1 )  .  X  )  is  empty,  then  the  operation 

defined.  If  the  ©Deration  is  ir’t  defined,  but  if  a  sequence  of 

operators  can  be  found  which  J  ”nges  _  into  *»  string  sf_  such  that  0  (s^)  is 

ij 


defined,  then  that  sequence  may  be  applied  to  s_  ,  and  the  final  operator,  0 


1  j  ’ 


to  JL*.  •  Finding  the  sequence  leading  from  £  to  Is  itself  a  problem,  so 

a  problem  contains  within  itself  subprobleras  which  can  be  attacked  by  the  same 
methods  used  to  solve  the  original  problem.  The  argument  that  this  is  so  is 
independent  of  the  methods  used.  rt  i:.. ,  simply,  that  if  the  subproblem  is  the 
same  type  of  problem  as  the  original  problem,  and  a  rational  approach  was  used 
on  the  original  problem,  then  why  should  the  subproblem  be  handled  differently? 

6 .  Proof  plans : 


4.1  General :  The  first  step  in  theorem  proving  in  this  fosmalisn;  is 
to  search  for  an  operator  which,  if  applicable,  will  remove  elements  from  the 
difference  set  £(£,£.)  •  Once  such  an  operator  is  found,  the  problem  cf  making  it 
applicable  is  established  and,  if  possible,  solved.  The  resulting  string  is  then 
examined  to  see  if  a  solution  has  been  achieved.  If  n^t,  the  procedure  is  repeated, 
until  a  solution  ia  reached  oi  until  patience  (represented  by  a  parameter 
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established  at  run  time)  is  exhausted.  If  this  strategy  is  to  be  successful,  we 
must  select  operators  which  generally  remove  more  differences  than  they  introduce. 
Also,  the  eubprobiems  of  applying  operators  should  bo  less  difficult  to  solve 
than  the  original  problem.  To  achieve  these  goals,  we  rely  heavily  upon  an 
"abbreviated"  look-ahead  method,  which  assumes  that  the  problem  of  applying 
operators  at  any  one  step  can  be  solved,  and  then  ssks  how  much  benefit  will  be 
gained  from  their  application. 

6 , 2  Finding  a  proof  plan : 

0 

6.2.1  Zero-Order  Operators:  Let  D  »  E (jt ,jg)  be  the  set  of 


zero 


V 

•order  differences.  For  -  very  (g^,k)  in  jD  ,3  difference  between  j  and 


j|  would  be  eliminated  if  s  were  to  be  rewritten  as  v  specification  of  g  , 

k  j 

This  can  only  be  done  by  rewriting  some  substructure  s(q)  of  _*  which  contains 
8^  as  me  of  its  symbslc.  By  examining  the  tables  of  symbol  trana  ormations, 
Che  effects  of  applying  each  rewriting  rule  at  each  position  in  js  can  be  deter¬ 
mined,  by  substituting  r^  into  s  at  the  appropriate  place.  If  the  use  ef 
on  a(q)  will  change  s^  to  a  specification  af  g4,  the  operator  0^  is 


0 


J 


iq 


added  to  the  sat  F__  of  zero-order  cperators.  At  this  point,  no  check  has 
been  made  to  determine  whether  0  (a)  is  defined,  i.e.,  to  see  whether  »(q) 

is  a  specification  of  . 

6.2.2  First-order  differences:  In  examining  the  second  table 

above,  suppose  we  find  that  some  operator  0^  will  change  s^  to  ,  but 

e  is  not  a  specification  of  g,  .  Now,  if  s  could  be  rewritten  so  that 
n  j  n 

it  was  a  specification  rf  g , ,,  then  0  could  be  used  to  remove  the  difference 

0 

(g  ,  k )  from  D  .  we  have  thus  discovered  a  new  intereating  difference,  namely 

J  — 


(Sjs  n)  (  *nd  it  would  seem  reasonable 
the  original  difference.  To  this  end, 
order  differences. 


to  tackle  it  in  the  same  way  »e  we  did 
(g^ .  n)  is  added  to  the  set  D  of  first- 


6.2.3  Higher-order  differences  and  operators-  After  ell  the 

0 

member*  of  J)  have  been  examined,  the  set  of  zero-order  operators  and  first- 
order  differences  will  be  complete.  The  eet  D*'  of  first-order  differences 

Q 

is  than  examined,  in  exactly  the  same  manner  as  j)  was  examined.  This  generates 

1  2 
two  further  sets,  J  ,  the  set  of  first-order  operators,  and  D* ,  the  set  of 

second-order  differences.  Repeating  the  same  procedure  again  results  in 

J23  -Td  l2  .  More  generally  given  J)“  ,  the  sets  J***  iud  J)™  ^  can  be  generated. 

i  P 

The  process  continues  vmtil  _D  is  empZy,  or  jp  has  b«en  generated,  where  js 
i*  a  parameter  specified  externally.  To  avoid  ’ooping,  an  operator  or  difference 
i»  not  added  to  ita  appropriate  set  if  it  is  already  a  member  of  that  or  some 
lower-order  set. 

Conroe nt :  By  uaing  this  procedure  we  have  *  definition  of  differences  between 
states  which  ia  entirely  syntactic.  The  user  of  a  program  need  not  specify  any 
•pedal  system  specific  routines  for  defining  differences.  The  user  can 
leave  the  definition  of  differences  ccxnpletely  under  program  control  by  not 
defining  classes  of  terminal  symbols  (e.g.,  by  treating  +  and  -  a®  unique 
symbols,  ins^aad  of  including  the  class  sdop.  in  the  algebra  example.). 

A  truly  general  general  theorem  prover  would  specify  the  value  of 


£  internally,  thus  deciding  to  go  tc  great  depth*  in  ej^ploring  promising  solutions 
while  abandoning  unpromising  lines  of  approach  rapidly.  To  do  this,  on©  would 
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have  to  have  srae  way  of  determining  the  probability  that  a  particular  line  of 
attack  was  going  to  result  in  a  successful  solution.  We  do  not  at  this  titse  have 
a  specific  proposal  which  we  care  to  defend.  As  a  practical  natter,  our  operating 
program  can  accept  an  initial  value  of  £  and  then,  if  that  does  not  work, 
increase  £  and  try  the  problem  again. 

6.3  Ordering  of  operators:  Let  P.  be  the  set  of  seta  {_?' }  , 
h  *  0  ...  £  .  P  contains  all  the  information  available  from  which  operators  can 
be  selected  as  likely  candidates  for  the  innermost  operator,  0  ,  in  ths  proof 

expressed  ia  5.2,  The  relevant  information  consists  of  the  audber  and  level  of 
differences  which  generated  each  operator,  the  complexity  of  the  operator  (obtained 
by  examining  its  rewriting  rule),  and  the  nuafcer  of  corrections  required  before  the 
operator  can  be  applied  (obtained  by  comparing  its  rewriting  rule  to  the  relevant 
substructure  s(|)  of  s_  )  ,  Let  F(P)  be  defined  as  a  function  which  orders 
the  set  of  operators  {0^}  >  which  appear  as  members  of  pairs  in  the  sets 
{ p!l }  .  vox  brevity,  we  will  write  F  for  the  ordered  set  of  operators.  £  is 
interpreted  as  an  ordering,  from  "probably  most  useful"  to  "probably  least  useful", 
of  operators  which  may  lead  to  the  next  step  in  a  proof. 

Comment;  In  a  specific  program,  the  definition  of  F(P)  is  crucial.  In 
describing  the  structure  of  a  class  of  theorem  provers,  it  is  sufficient  to  assert 
that  F(P)  exists  and  that  it  orders  operators.  An  advantage  of  the  formalization 
ia  that  it  makes  clear  ways  in  which  two  programs  could  differ  and  still  fall 
within  the  class  of  programs.  For  instance,  it  is  conceivable  that  in 

different  problem  areas  (e.g,,  trigonometry  as  opposed  to  the  predicate  calculus) 
different  algorithms  for  F(P)  would  be  appropriate.  Ia  our  own  work  we  have 
experimented  with  several  algorithma.  The  results  of  these  studies  will  be 
reported  elsewhere- 
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7.  Procedures  for  solving  problems: 

7.1  General t  Using  the  above  definitions,  we  now  present  two 
procedures  for  problem-solving.  The  first  is  a  recursive  procedure,  in  the 
"Algol"  sense  that  a  class  of  algorithms  are  specified  which  call  therm; elves 
as  subroutines.  This  procedure  has  a  structure  very  similar  to  that  of  a 
top-down  compiler-compiler.  We  then  show  that  there  exist  problems  which 
cannot  be  solved  by  any  algorithm  in  the  class.  Next  we  described  a 
modified,  non-recursive  procedure  which  describes  the  structure  of  our  current 
working  programs.  Henceforth  this  will  be  referred  to  (for  historic  reasons 
only)  as  the  "Fortran  Deductive  System",  or  FDS,  algorithm.  We  show  that 
problems  which  previously  escaped  solution  using  the  recursive  procedure  can 
be  captured  by  the  FDS  algorithm. 

7.2  The  recursive  procedure:  Given  the  problem  of  rewriting  s 
as  a  specification  of  j*  »  and  two  externally  specified  parameters  £  and 
proceed  as  follows: 

(1)  Set  lc  *  0  ,  s*  •  s  ,  «  j  .  (The  variable  k  will  be 

used  to  simulate  the  level  of  recursion  of  the  problem-solving 

procedure) . 

(2)  Set  k  ■  k  +  l  .  Tf  k  >  r  ,  then  go  to  step  (7)  , 

otherwise  go  to  3ten  (3)  . 

G  k  k 

(3)  Determine  D  »  E(s^  ,  &  )  ,  then  P_  (sectio:-  6)  ,  and  set 

Fk  -  F(P)  .  If  D°  $  go  4.0  step  (6);  otherwise  assert  that 
k  k 

the  probl'm  is  solved,  set  jft  *  k.  ,  k  ”  0  and  go  to 

step  (4)  . 

k  ft 

(4)  Set  k  •  k  +  1  .  If  &  "  «»' 

otherwise  return  to  step  (4)  . 

’  )  •  ■  ’  I  .  :  •  ' 


v 


then  go  to  step  (5)  , 
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(5)  Set  k  *>  k  ~  1  .  If  k  *  0  ,  assert  that  the  main  problem 


is  solved,  sad  quit.  Otherwise,  find  the  operator  which 


.  ,  ,  k  k+1 

generated  the  goal  £  ,  set  s_ 


n  ,  K  k+1 
01;j(s  ?  »  £ 


£ 


£ 


and  go  to  step  (2)  , 
k 

<&>  If  _F  '  «  p  then  go  to  step  (7)  ,  otherwise  go  to  step  (8)  . 
k  k 

(7)  The  problem  £  ,  £  cannot  be  solved.  If  k  **  1  ,  then 


assert  total,  failure  and  quit;  otherwise  set  k  *  k  -  1  .  If 
k  k+1 

£ '  y  £  ,  then  set  £  =  £  +  1  .  Go  to  step  (6)  . 

(S'  Remove  the  first  operator  from  ?  ;  call  it  0  . 

ij 

...  „  y  ,  k+1  „  .  kv  k+1  k  , 

If  0  (s  )  is  defined,  set  £  =  0  (s  )  ,  £  “  £  and 

i  J  *3 


go  to  step  (2)  .  Otherwise, 
return  to  step  (6)  . 


£  >  0  ,  go  to  step  (9)  else 


(9)  The  subgoal  of  applying  0  is  to  be  established.  Let 

ij 

k 

€ Cj_)  he  n  function  whose  value  is  >  where  s  (1)  is  the 


ath  direct  component  of  s„  .  Initially,  set?  £ 

~  p 


k+1 


to  the 


string  2^  ,  then  execute  the  following  steps  in  sequence: 

(9.1)  If  j_  ■  0  ,  go  to  step  (9.5). 

(9.2)  Let  f(i)  be  {a, 8}  .  Set  i  -  I  . 

k 

(9.3)  Let  the  degree  of  symbol  be  £  ,  and 

let  X  mean  "any  symbol  of  degree  n"  . 
J1  — 

Form  the  string  £  *  ^ i+2  *** 

k+1  „  “ 


t+a-I  u 


i+a+1 


. .  V  wnere  i  is 
i+n  — 


defined  as  the  highest  index  of  a  free 


variable  In  £ 


k+1 


„  k+1 

Set  £  to  u 
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(0 .4)  Return  to  step  (9.1)  . 


(9.5)  Set  j>  «  p  -  1  ,  s 


k+1 


s_  ,  and  go  to  step  (2) 


Alter  steps  (9.1)  -  (9.5)  have  been  executed  and  control  returns 
k+1 

to  step  (2),  g _  will  be  a  structure  with  the  following  properties: 

k  k 

(a)  Tne  symbol  in  will  correspond  to  the  symbol  marking 

k+1 

the  start  of  the  structure  X.  in  g 

1 

Ic 

(b)  The  first  symbol  of  every  other  structure  in  s_  will 

correspond  to  a  free  variable  symbol  i  .  Thus,  if  b^Cj)  is  a 

k+1  k+1 

specification  of  is  guaranteed  to  be  a  specification  of  g  . 

If  the  procedure  finds  a  solution,  it  will  produce  one  using  not 

wore  than  £  levels  of  recursion.  At  no  state  will  it  "look  ahead"  more 

than  >  aubptoblems  to  see  if  an  operator  may  be  applied.  Ir teres tingly , 

increasing  the  values  of  £  and  p  beyond  the  minimum  values  needed  to  find 

any  proof  hardly  ever  results  In  finding  a  more  direct  proof.  This  is  because 

th  increased  parameters  will  permit  an  extension  of  the  9et  ?  to  more 

operators,  and  unless  the  ordering  within  F  is  perfect,  there  is  always 

a  chance  U\at  an  operator  which  leads  to  no  proof,  or  to  &  true  but  awkward 

proof,  will  be  tried  befc.'e  an  operator  which  leads  to  a  direct  proof.  Some 

examples  of  this  phenomenon  arc  given  in  (9) . 


Conroent  on  programing:  we  ha»te  , /resented  a  non-re^ursive  method  of  storage 
allocation  by  manipulating  the  pointer  k  and  indexing  £,  £  and  F  .  In 
c  programming  language  which  permits  dynamic  storage  allocation,  the  coding 
problem  is  touch  simpler. 

7 . 3  A  class  of  problems  not  handled  by  thp  recursive  procedure : 
Starting  with  an  original  problem  s^_  ,  ,  suppose  that  the  subproblem 
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2  2  j 

s_ ,  £_  is  generated,  as  In  step  (9)  of  7.2.  Any  rewriting  of  s_  into  a 

2 

structure  which  is  a  specification  of  jt__  is  a  solution  to  the  subproblem. 

* 

Let  us  suppose  that  two  3»<~h  solutions  exist  resulting  in  structures  s_  and 
s  ^  ,  By  hypothesis,  the  rewriting  rules  given  could  generate  either  of  them, 

A  particular  ordering  function,  however,  will  uncover  one  of  them  first.  Let 

a  3 

this  be  s_  .  Upon  finding  this  rewriting,  s__  will  be  defined  as 

-%<*!>. 

3  3 

and  control  will  be  passed  to  step  (2)  at  which  point  the  problem  s_, 

is  attempted,  Asse.e  that  this  problem  cannot  be  solved.  Control  will  be 

returned  to  step  (o)  of  7,2.  At  this  point,  if  0^  .  was  the  la?  .  operator  on 
1  1 

F  ,  F  will  now  be  empty  anu  failure  will  be  asserted.  Failure  will  also 
be  asserted,  although  somewhat  later,  if  the  operators  following  U  on 
do  not  produce  steps  whi :h  lead  to  a  proof. 


Suppose 

,  however 

,  that 

rhe 

'  step 

step  in 

the 

proof . 

Bv  by pot 

has in , 

tin 

’  revr 

can  be  rewri 

tten  as 

a 

s  ,  bu 

t  in  t 

he  t 

ornul 

step  wil 

l  ne 

ver  be 

reached  s 

in ct  once 

•V 

removed 

from 

f5_  . 

On  t',  •  o 

ther  h 

:m<! , 

not 

would  re 

suit. 

in  looping. ,  in 

bri.  f 

»  a,; 

iv  ;cl 

unique . 

7 . An 

>.  sample 

o  f  the 

clj 

S‘  : 

both  the 

pro 

ceduro 

os  7.2  an 

1  the 

f  1  ;n ' 

1  dv  sc 

The  pro 

bier;  are? 

is  a 

rlv  r< 

the  vocabulary  consist:  of 
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(1)  The  terminal  symbols  anu  0  ,  of 
decree  0  ,  and  +  of  degree  2, 

(2)  Free  variables  V  as  necessary. 

_L 

(3)  The  terminal  classes  *  {  +  }  ,  a 
{  t  and  C„  ®  JO}  . 

j  — 


The  set  R  Is  the  three  rewriting  rules 


si  :£  -  2  vi  =•  \ 


The  initial  problem  is 


*2  :s  Vj_  ±0  ^ 

r  •  =  +  v  v  •  «  4-  v  v 

i  •-  Z  vt  v7  •  -  -  V1 


£**+_X0,£“X 


Sctti.;.h  ?.rd  ^  to  these  strings,  step  (3)  of  7.2  generates  0^  “ 

{(X,  0)}  ,  from  which  we  »ec  F*  -  {0  A '  .  Since  0  (+  X  0)  is  not 

1  y  V  X  •  ’ 

defined,  we  generate  the  subproblem 

s  2  -  +  X  0  ,  nl  -  i  0  V 

The  subproblem  generates  the  set  of  a.ro  order  differences, 

9—  *  ((0,1).  (V^,  7)}  ,  and  »  (U.,  ^  f  .  Since  0,  |) ( s ^ )  is 


defined,  th"  new  problem 


*  ±  o  1 x  2.  .  ji_  m  t  9.  V1 


3  3 

is  generated,  s^_  is  now  a  specification  of  £_  ,  «o  by  repeatin'*  step  (4) 

set  k  to  1  and,  after  sing  0  on  s2  ,  continue  with 

l.o 

s^  -  ±  X  0  ,  X  . 

2  1  2  1 

Now  9  «  s__  and  ;  th  problem-sol  vine,  procedure  is  caught  in  a 

loop.  This  situation  is  detected,  rise  problem  s__,  g?_  is  failed,  and  the 
system  returns  to  the  situation 


"t  ' 


%  k  ^ 

•  •  \r 
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k  =  1  , 

from  which  step  (7)  of  7.2  asserts  failure. 

7.5  The  nou-recursivc  modification;-  Hie  re  wore  two  solutions 
2  2 

to  the  problem  s_,  £_  ,  and  the  program  accented  the  wrong  one.  I"  the 

modification,  the  fully  recursive  structure  is  abandoned,  allowing  the 
program  to  try  a  subproblem  a  second  time  if  necessary. 

This  is  done  by  not  "reporting  back"  when  a  subproblem  is  solved, 
but  rather  bringing  forward  the  previous  goal.  Specifically,  if  while 
considering  problem  s*,  g*  ,  the  operator  0  general -os  the  subproblem 

(1 P 

s1+i  »  ,  and  this  is  solved  by  finding  a  structure  a*  ^  which  is 

a  specification  of  £^+  ■  -  £i+^  ,  then  the  new  subproblem  * 

0  „  (s^+h  ,  a*  ^  ■  g^  is  established.  From  its  index,  this  is  seen  to  be 
as  —  ■CL 

,  ,  ,  ,  i+1-1  i+j-1  ,T  .  ill  1 

s  subproblem  of  s^  '  »  £  .  (In  the  case  £  *  £_  ,  success  is 

1+1  1+1 

asserted.)  Note  that  If  the  particular  subproblem  s  ,  £  turns  out 

to  be  unsatisfactory,  a  -ew  solution  will  he  sought  for  a*  ^  ^  ^  . 

To  achieve  this,  change  stop  (R)  of  7.2 

(3)  If  g'K  «  ,  asset,  that  the  main  problem  is  solved  and 

quit.  Otherwise,  sot  k  »  k  -  1  .  Find  the  operator 

n  r  R 

•’ll  vhlch  ********  '  "  °ij(2-  '  > 

*-•  \ 

«■  oK  ,  p  *-  p  +  1,  k  "  k  -  1  and  go  to  aten  (2)  . 


61 

~~en  t : 

Clearly  ..  th 

is  destrosa  c 

he: 

rv.  curst  vo  aatur 

e  o  f 

the 

algorithm. 

since 

it 

permits 

high  level 

sub problems 

to 

h <1 v c  a c c c s ci  to 

lov 

leve  1 

goals . 

7 .  b  The 

example  probl 

03 

revisited:  Hie 

mod 

ified 

procedure 

solves 

th«  illustration  problem  as  follows: 


l'J 

The  development  la  Identical  to  7.4  through  the  first  occurrence 

3  3  2  2 

of  the  problem  s_ ,  Following  its  solution,  instead  of  returning  to  8^,  g  , 

we  have 

3  3 

s  »  +  X  0  ,  g_  -  X 

3  13  1 

Again  we  note  s_  -  js  j*  -  £  ;  so  a  return  is  nu.de  to  the  situation 

k  -  2  ,  .2  -  ±X0  .  22  -  £-  WJj0). 

2 

Since  0^  q  (a  )  is  defined,  we  get  the  new  problem 

s 3  -  +  0  X  .  -  +  0  V 

3  3 

£  la  a  specification  of  £  ,  and  so  by  step  (?)  we  have 

s3  -  o,  (+  £  x)  -  x  ,  i  -  x 

-  »-■' 

3  3  3  1 

Now,  £  Is  o  specification  of  £  ,  and  since  &.  m  Z  the  original 

problem  la  solved, 

Co— ent :  The  modified  procedure  has  proven  that  0  +  X  »  X  ,  hardly  a 
result  of  great  surprise.  And  it  did  it  with  only  one  tslsc  start! 

"Obviously” ,  one  would  avoid  the  need  for  elaborate  procedural  arrangements 
of  this  sort  if  the  correct  operator  was  tried  first.  If  an  algorithm,  for 
doing  this  were  known ,  the  act  of  nroving  theorems  would  be  trivial.  13)0 
modified  procedure  safeguards  one  against  less  than  perfect  orderings  of 
operators . 

8.  Discovery  of  solutions  to-  problems:  ’..’e  shall  iuv  die  fine  the  class  of 
problem  which  our  modified  system  can  solve.  For  this  purpose ,  we  shall 
assume  that  the  parameters  _r  and  £  arc  unbounded ,  as  limiting  these  i-crvos 
mare ly  to  increase  the  efficiency  of  the  svstem. 
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8.1  Notation:  Let  .  Y  0^  denote  the  sequence  of  operations 

a-tn  a  a 

defined  by 

n 

Y  0  (s)  -  0  (01  (...0  (s)...))  . 

a*m  era  trn  n-lJn-l  Harm”* 

This  compound  operator  will  be  used  only  where  each  operation  in  the 

n 

sequence  is  defined.  If  Y  0  (s_)  is  a  specification  of  some  structure 

a*m  aJa 

£  ,  then  the  ordered  set  {0.  ,  a*  n,  n}  is  a  solution  to  the  problem 

a^a 

£  ,  &  .  Finally,  let  0(0^ (js))  denote  the  "try  to  apply  0^  to  s_"  . 

The  generation  of  an  appropriate  goal  structure  was  defined  in  7.4.9  . 

8.2  Difference-discoverable  solutions:  In  general  a  problem  has 

many  possible  solutions.  These  can  be  dlchotonized  by  caking  the  following 

1c  It 

question:  At  each  step  s.  ,  in  the  solution,  can  what  to  do  next  be 

1c  Ic  k 

discovered  by  analysis  of  only  s_  and  E(£  ,  £  )?  Formally,  we  call  a 

solution  it  »  {0^  '  ,  a*  m,n  }  to  the  problem  s  ,  j»  "difference- 
a  a 

discoverable"  if 


8.2.1  £  S  and  it  ■  0  ,  or 

8.2.2  there  exists  an  0.  contained  In  it  fl  £  such  that  the 

solutions  (0  .  ,oi  “m,  6-1)  to  s_  ,  G(0  .  (s))  rsd 

Va  B  Vb  ' 

{ 0  ,  a*  8  +  1,  n}  to  Y  0^  .  (s)  ,  &  are  both  difference-discoverable . 

a**  a  a«m  33 

Comment :  I*  is  constructed  in  such  a  way  that  it  will  certain  every  operator 
which  reduces  D  ,  and  hence  may  be  instrumental  in  reducing  .  Thus, 

0  e  P.  implies  that  an  attempt  will  be  made  to  font  0.  (s)  .  If 

Vb  Vb 

0.  is  also  a  member  of  it  ,  then  this  attempt  and  tl  subsequent 
application  of  0.  will,  if  made,  lead  to  the  first  i  steps  of  ir 

Vb 
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feeing  discovered.  (The  attempt  my  not  be  made  if  the  gth  step  of  i*  is 
reached  in  am*  other  way.) 

Example :  In  understanding  this  definition,  it  is  illuminating  to  consider  an 

example  of  a  solution  which  is  r  .  difference-discoverable.  Let  MINUS  denote 

unary  minus,  and  define  the  rewriting  rules 

R. :  2  MINUS  x  V,  V„  ;»  x  V,  MINUS  V, 

1  — — -  _1  _2_  —  __2 — 

1<2 :  =  x  x’i  v2  £  V,  V 

Consider  the  problem 


s_  “  MINUS  jc  a  fe,  g  *  _x  a  Minus  b 
which  has  the  solution 

’  ■  {02,i  ■  °1,0! 

r/'  :  E(b,£)  "  t<x,  0'}  ,  P  n  ,  }  *  «  n  P  .  Since  ?  &  ,  the 

only  0  for  8.2.2  is  0.  _  .  Thus  the  solution  ~  to  s  ,  g  is 

Vs 

difference-discoverable  if  and  only  if  the  solution  x*  *  {0 .  }  to  s_  , 

g*  -  0(s))  and  x**  -  <b  to  s**  =  0(0.,  ^(s))  ,  g  are  difference- 

discoverable.  Bu*  s  S  g*  and  x*  4  y)  ,  so  the  solution  n*  to  s  ,  g* 
is  not  difference  discoverable;  thus,  neither  is  the  solution  n  to  3,  g  . 

The  result  could  be  predicted  from  the  intuitive  concept  of  difference- 

0 

discoverability  given  in  the  beginning  of  this  secrion.  Initially,  D__  “ 
l(*,0)}  .  Tlu  ui ry  way  to  remove  this  difference  is  to  use  R^  .  However, 

the  fact  that  0  mu9t  be  used  to  switch  a  and  b  before  removing  this 

difference  cannot  be  detected  by  the  procedures  riven  in  section  6.2. 

8.3  Problem-solving  scope  of  the  3ystem:  Any  difference-discoverable 


solution  to  a  problem  can  be  foun  1  by  the  FDS  algorithm. 


Since  we  shall 
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be  talking  about  the  system  finding  particular  solution,  we  add  (temp¬ 
orarily)  an  extra  switch,  or  "demon”  to  the  system.  Tnis  will  check  any 
solution  found,  and  if  it  is  not  ;V  sn^yirud  one,  will  discard  it  and  keep 


looking. 

Lei  s  ,  g  be  a  problem  with  the  required  difference-discoverable 

solution  x  **  {0^  ,  a  *  1  ,n  }  .  Out  proof  will  be  by  induction  on  in  , 

ora 

the  number  of  steps  in  the  required  solution. 

In  the  case  n  »  0  ,  the  theorem  is  trivial;  £  S  jg  and  since 
it  is  difference-discoverable,  *  *  0  by  3,2.1.  The  required  proof  will 
be  detected  by  step  (3)  of  7.2. 

Assume  then,  that  any  difference-discoverable  solution  of  less  than 
n  steps  ~an  be  found.  Since  n  *  0  ,  x  ^  <f  ,  and  so  there  must  be  an 
O-i  <  »  i  £  8  <  n  which  satisfies  8.2.2.  That  is,  the  required  solutions 

Vs 


0 


3  aJci 


.  ,a  »  l.S  -  1}  to  s  ,  G(0  (5))  and  x**  «*  [0  ,  a  «  0  +  1,  n) 

j~  ~  1BjB  iJ' 


a  a 


to  Y  0  (s)  ,  ^  are  difference-discoverable.  Since  these  are  both  of 

a».l  '  a' a 

n  steps,  thev  can  be  discovered.  The  demon  guarantees  that  eventually  all 
difference-discoverable  solutions,  and  hence  x  ,  will  be  discovered. 
Comment :  To  see  why  this  proof  does  not  applv  to  the  recursive  formulation, 
add  the  same  demon.  Now  suppose  that  the  first  solution  found  to  s  , 

G(0,  ,  (»))  is  not  n*  .  IThen  failure  is  finallv  asserted  on  the  other 

V  6 

problem,  0  will  be  removed  from  ,  and  no  further  solution  sought 

Ve 

to  the  first  subproblem.  Thus,  the  discovery  of  n*  cannot  be  guaranteed, 
so  neither  can  discovery  of  x 

If  a  problem  has  at  least  one  difference-discoverable  solution,  a 


solution  will  be  found.  The  particular  one  found  will  depend  on  the  ordering 


function  F (V)  .  Empirically,  we  have  found  that  problems  without  at  least 

one  difference-discoverable  solution  are  rare.  Only  or.e  such  problem  has 
been  found  in  our  study  of  over  one  thousand  problems  from  diverse  areas  of 
mathematics.  Thus,  we.  feel  that  this  limitation  is  not  overly  restrictive. 

It  would  be  nice  if  there  were  some  way  to  look  at  a  problem  and 
say  that  it  does,  or  does  not,  have  a  difference-discoverable  solution. 

This  is  a  chimera.  Difference-discoverability  is  a  property  of  solutions, 
not  of  problems.  To  state  ir,  advance  that  a  problem  does  or  does  not  have  a 
differtnce~diseoverab le  solution  requires  that  one  make  an  assertion  about 
the  form  of  a,  solution  before  he  knows  what  the  solution  is. 

Another,  way  of  looking  at  this  is  to  say  that  we  are  rlealing  with 
an  algorithm  wh  ii  is  not  complete  -  einca  it  will  not  always  prove  a  true 
theorem.  This  is  ia  contrast  to  theorem  prove ra  based  on  the  resolution 
principle,  for  which  completeness  can  be  proven  (10).  Should  we  be 
interested  in  incomplete  theorem  proving  methods?  The  answer  depends  on 
their  pragmatic  utility.  Is  the  expense  of  possible  failure  offset  by  an 
ability  to  handle  some  problems  very  well?  The  following  section  addresses 
this  point. 

9.  Ex-amp  I.  '8 

9.1  General:  We  will  now  show,  by  illustration,  w’here  tb**  FDS 
algorithm  does  or  does  not  perform  well.  The  algorithm  is  quite  effective  if 
the  theorem  has  a  proof  in  which  each  line  is  derived  by  application  of  a 
rule  of  inference  to  the  line  derived  immediately  before  it.  This  will  be 
referred  to  as  the.  "line  by  lino  property.”  The  algorithm  is  much  less 
suited,  and  indeed,  appears  clumsy,  if  the  "natural"  proof  (to  a  human)  depends 


or  the  convergence  of  two  or  more  chai. :<?  of  inference.  Because  aany  very 
difficult  proofs  are  of  the  latter  type,  and  because  we  have  used  very 
simple  examples,  it  may  appear  at  first  that  the  algorithm  is  suitable  only 
for  trivial  problems.  This  is  not  so,  as  a  line  by  line  proof  may  involve 
steps  which  are  difficult  to  find,  and  our  simple  examples  were  chosen 
solely  for  ease  of  exposition.  Several  of  tho  following  illustrative 
pre.-teroa  are  quite  difficult  for  people.  As  appropriate,  we  shall  cite 
st' tistics . 

Within  each  example,  a  program  fitting  the  FDS  algorithm  (i.e., 
behaving  as  we  have  specified  except  tha..  a  specific  ordering  rule  was  stated 
to  define  F(P))  was  given  an  initial  set  of  rewriting  rules,  then  a  series 
of  problems.  Each  time  a  problem  was  solved,  (except  in  pattern  identification) 
the  appropriate  theorem  was  added  to  the  list  of  rewriting  rules  available  for 
subsequent  problems. 

9.2  Elementary  algebra:  Elementary  algebra  is  a  system  in  which 
most  proofs  have  the  line  by  line  property,  and  hence  the  algorithm  works 
well.  Tills  Is  illustrated  in  Tables  1  and  1,  which  summarize  the  result  of 
an  experiment,  with  school  algebra  problems.  Table  1  states  a  set  ot  axioms 
and  problems  involving  algebraic  manipulation  of  plus  and  binary  minus.  In 
Table  2  manipulations  of  zero  and  unary  minus  arc  defined. 

'Everyone  knows"  these  theorems  are  true,  but  it  is  surprisingly 
hard  to  prove  them.  The  rewriting  rules  and  problems  one  to  thirteen  of 
Table  1  were  presented  to  fifteen  University  of  Washington  undergraduates 
euro..  ’  in  introductory  psychology.  Although  high  school  alg.ebra  is  a 
requirement  for  admission  to  the  University,  and  on t ary  statistics 
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taught  as  part  of  this  course,  the  students  did  quite  poorly.  They 
averaged  two  and  a  half  solutions  in  half  an  hour.  The  best  problem 
eolvar  produced  only  seven  proofs. 

Some  of  these  problems  are  not  trivial  for  people  who  have  had 
considerable  formal  mathematical  training.  In  particular,  consider 
problem  7  of  Table  1.  We  have,  informally,  presented  this  problem  to  about 
a  dozen  graduate  students  or  Ph.D.'s  in  Mathematics,  Engineering,  and 
Computer  Science,  allowing  from  ten  to  forty-five  minutes  fee  work  on  it. 
Only  a  few  people  solved  the  problem.  The  fastest  solution  obtained,  a 
different  proof  from  that  found  by  FBS,  was  found  in  ten  minutes  by  an 
undergraduate,  who  subsequently  was  elected  to  Phi  Beta  Kappa  in 
Mathematics  for  other  reasons. 

9.3  Sanderson  al  ebra:  "Sanderson  algebra"  is  an  algebra 
developed  by  Dr.  j.  Sanderson  to  describe  simple  flow  charts,  such  as  might 
occur  in  microprogramming,  (12).  Proving  that  two  well  formed  expressions 
are  equivalent  in  this  algebra  proves  that  the  flow  charts  they  describe 
are  computationally  equivalent.  Table  3  ii3ts  the  twenty-six  "axioms",  or 
equivalences,  which  banderson  proved  by  showing  that  all  possible  inputs 
to  the  corresponding  circuit.,  gave  equivalent  outputs.  He  then  proved 
the  fifteen  theorems  listed  as  problems  in  the  table.  The  theorems  have 
also  been  proven  by  the  FDS,  with  the  times  listed. 

This  example  Illustrates  the  strong  "non-reflectivity"  of  the  FDS 
algorithm.  The  algorithm  must  begin  with  th^  starting  state,  and  then 
rewrite  to  the  goal  state,  v/t.ere  a  human  theorem  provei  might  reverse  the 
process.  This  is  illustrated  in  Table  3,  problems  13  and  14.  These  are 
reflexive  versions  of  each  other,  yet  by  a  time  to  solution  criterion,  one 


problem  is  500  times  harder  than  the  other!  In  practice,  the  FDS  algorithm 
ought  to  be  supplemented  by  a  pre-processor  which  decided  *"hat  ijf 
was  reflective  in  the  deductive  system  being  handled,  and  the  problem  was 
of  the  form  "a  :«  b"  ,  it  would  be  easier  to  prove  "b  :=  a".  But  how  is 
this  decision  to  be  made? 

Eight  Univ  isity  of  'Washington  Junior  or  benior  majors  in 
Mathematics  spent  three  hours  each  attempting  to  prove  the  problems  of 
Table  3.  The  system  x;as  presented  to  them  with  reflectivity  of 
assumed,  so  that  if  anything,  they  had  an  easier  tosh  than  did  the  FDS 
program.  (There  are  then  seven  problems.)  The  average  student  obtained 
two  solutions.  Only  one  student  solved  all  problems  In  eighty  mine  as. 

9.3  Pattern  identification:  Our  next  example  involves  parsing 
strings  in  a  phrase  structure  grammar.  This  example  was  chosen  to  show 
the  resembelance  of  the  FDS  algorithm  to  compilation.  In  addition,  this 
example  illustrates  the  application  of  the  algorithm  to  a  slight  extension 
of  the  theorem  proving  problem.  Instead  of  being  asked  to  find  a  sequence 
of  transformations  which  change  the  starting  state  into  the  goal  star-', 
the  program  is  asked  to  detect  to  which  of  several  classes  of  strings  a 
particular  well  formed  expression  belongs. 

Two  dimensional  line  drawings  of  buildings  provide  the  subject 
matter.  For  ease  of  exposition,  think  of  "houses"  and  "churches."  Proto¬ 
type  houses  and  churctu  are  shown  in  Figure  I  .  Given  a  set  of  basic 
patterns,  complex  two  dimensional  variations  of  these  patterns  can  be 
constructed  by  specifying  a  set  of  connectives  (e.g.,  "on  top  of")  and  a 
phrase  structure  grammar  whose  rules  determine  the  variation  of  patterns 
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which  fail  into  a  particular  class,  (4,5).  A  typical  set  of  rules  arc 
given  in  (4)  .  These  are  similar  to  the  rules  used  in  this  application, 
with  the  following  exception.  Let  {B^}  ,  i  »  l...n  ,  be  the  set  of  n 
prototypes,  in  this  case  the  n  basic  patterns  representing  different 
types  of  "house"  or  '  ^.nurch".  The  revjriting  rules  contain  n  rules  of 


the  form 


Bt  :=  PATTERN 


where  "PATTERN"  ia  a  special  constant  that  only  appears  in  rewriting  rules 


on  the  right  hand  side  of  the  above  n  special  rules  and  in  the  rule 
PATTERN  .  PATTERN  PATTERN  .  If  the  problem  A  :*  PATTERN  is  pre  -ented, 
where  A  ia  any  well  formed  expression,  if  the  program  solves  this  problem, 
it  will  have  first  rewritten  A  as  some  collection  of  the  {B^}  then  made 
the  trivial  last  steps  of  rewritting  to  PATTERN.  If  the  each 

represent  one  of  the  basic  types  cf  patterns,  then  the  i^exl  formed  expression 
(complex  picture)  A  will  have  been  classified  as  a  particular  type  of 
pattern. 


'1 


*}t; , 


t : 


Figure  2  shows  two  basic  patterns  and  c  :e  of  the  cor‘v>ouad  patterns 

whicn  have  been  classified  as  examples  of  each  type.  In  this  example  there 


m 


are  eight  basic  patterns,  and  26  problems  were  attempted.  Proofs  in  this 
application  are  quite  direct,  and  are  obtained  in  a.,  average  time  of  six 


seconds . 


V'f/j 


9.5  Propositional  calculus:  The  previous  illustrations  have  been 
of  theorem  proving  in  systems  which  have  the  line  by  lire  property.  More 


specifically,  each  system  has  axioms  of  the  form  X  is  equivalent  to  Y  , 
with  the  added  assumption  that  within  an  expression  any  subexpression  may  be 
replace;*  by  one  of  its  equivalent  expressions,  he  will  now  give  a  example 


[  \  I 
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o.  how  poorly  the  FDS  algorithm  performs  If  It  Is  asked  to  prove  theorems 
in  a  systen  which  does  not  have  this  property.  The  svstem  is  the 
propositional  calculus.  The  following  axioms  are  true  statements,  but  not 
statements  of  equivalences. 

a  (h  a; 

(a  -  (b  c))  ((a  b)  (a  c)) 

(  jK  .-,va)  .a  ((  b  a)  -v  b) 

To  begin  an  FDS  computation  at  all,  these  were  expressed  by  three  rewriting 
rules  of  the  form 

x  :*  x,(a  (b  a)) 

together  with  the  rule  of  Inference 

(x,a),  (a  h)  :**  x,b 

The  first  set  of  rules  say,  in  effect,  that  any  expression  nay  be  rewritten 
as  itae.lf  and  an  axiomatic  statement.  The  second  is  a  rewriting,  form  of 
modus  ponens .  In  ten  minutes  the  system  was  unable  to  prove  that  5  a  , 
is  a  true  statement .  The  reason  is  that  in  any  ays tom  where  one  step  is 
required  for  each  substitution,  this  is  an  extremely  Ions;  proof.  Also, 
the  starting  state  provides  very  little  clue  as  to  '/here  to  begin.  This  is 
seen  by  examining,  the  rewri tine  rule  form  of  tue  problem 

x  : =  x ,  a  lb  a 

The-  algorithm  is  appropriate  lor  many  rewriting,  problems  which 
appear  to  be  like  the  propositional  calculus,  hut  are  in  fact,  problems  of 
inference.  A  systematic  examination  of  the  problem  sectio  's  ot  Suppes  and 
Hill’s  Introductory  Logic  tor  the  Schoo 1 s  (14),  uncovered  no  problems  which, 
in  principle,  could  not  be  solved  h-v  the  FDS  method .  In  some  cases  we  dlo 
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not  cate  to  expend  the  necessary  computing  time  on  hard  examples.  Table  4 
illustrates  system  performance  on  problems  Suppes  and  Hill  used  to  illustrate 
infe  fences  by  modus  to  1 lens ,  modus  ponens ,  and  double  nega t ion .  Our 
observation  was  that  most  of  the  applications  of  logic  in  this  grade  school 
book  were  to  the  use  of  logic  to  draw  inferences,  rather  than  to  prove 
theorems . 

9.6  A  puzzle:  This  example  is  a  version  of  a  well  Known  logic 
puzzle.  Most  people  find  it  hard  the  first  time  they  see  it. 

There  are  two  protagonists,  Ed  and  Al,  each  of  whom  either  always 
fells  the  trut.h  or  always  lies.  A  philosopher  approaches  the  pair  and 
eflks  If  the  library  is  to  the  East  or  West.  Ed  mutters  something  unintel¬ 
ligible,  and  Al  states  clearly,  "Ed  says  east,  but  he's  a  liar."  Where 
is  the  library? 

FDS  uses  the  notation 


FDS  Expr ess  ion 


Meaning 

— - v* 


SAYS  (A/B) 
A . IS . TTLE 
A.  IS.  LIAR 
A  .  IM .  B 
A  .  EQ  .  li 
DIRN 
A  '  I)  '  B 
(A)AND . 3 


A  makes  statement  3 

A  is  truthtel  ler  ( i  .e  .  ,  honest  citizen! 
A  is  a  liar  (i.e.  gangster) 

A  implies  B 
A  is  equivalent  to  B 
A  direction ,  i.e.  either  east  or  west 
A  may  be  rewritten  as  8 
A  ami  3 


and  the  rewriting  rules: 


SAY S (A / B )  :«  f A .IS. TTLR 1 . EQ  3 

A.  IS.  LIAR  :•>  LOT  (A.  IS.  TTLR) 

NOT (EAST)  ■  EST 
LOT (WEST)  :=  EAST 

(A.EQ.B)  AND.  NOT  (B)  «=  DATA  .  1W .  NOT  (A) 

A.Eq.B  : ’  3.F.Q.A 
A  .  F.Q .  (B.EO.C)  .  “  (A .  Ev? .  3 )  EO  .  0 
A . EQ .  NOT (B)  : -  NOT  (A . EQ . B ) 
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The  problem  was  presented  as 

SAYS  (AL/SAYS  (ED/EAST))  .  SAYS  (AL/ (ED. IS. LIAR))  DATA.IM.DIRN 

The  program  produced  the  following  proof  in  14  seconds. 

(SAYS (AL/SAYS (ED/EAST) ) AND. SAYS (AL/ED. IS . LIAR) ) ) 

( ( (AL . IS .TTLR) . EQ. SAYS (ED/EAST) )  A1!D.  SAYS (AL/ (ED. IS .LIAR)  ) ) 

( ( (AL . IS . TTLR) . EQ . SAYS (ED/EAST) ) AND . ( ( AL. IS . TTLR) . EQ . (ED. IS .LIAR) ) ) 

(( (AL . IS . TTLR) . EQ . SAYS (ED/EAST) ) AND .( (AL . I S . TTLR) . EQ . NOT (ED. IS . TTLR) ) ) 

( ( (AL. IS .TTLR) . EQ . SAYS (ED/EAST) ) AND . HOT ( (AL . IS . TTLR) . EQ . (ED . IS .TTLR) ) ) 

( ( (AL . IS . TTLR) . EQ . ( (ED . IS . TTLR) . EQ . EAST) ) AND. NOT ( (AL . IS .TTLR) . EQ . (ED. IS . TTLR) ) ) 

((((AL. IS. TTLR) .EQ. (ED.IS. TTLR) ) .EQ.EAST)AND. NOT((AL. IS. TTLR) .EQ. (ED.IS. TTLR))) 
( (EAST.EQ. ( (AL. IS .TTLR) . EQ. (ED. IS .TTLR) ) ) AND.NOT( (AL. IS .TTLR) .EQ. (ED.IS .TTLR) ) ) 
(DATA. IM.NOT(EAST) ) 

(DATA. IM. WEST) 

This  example  illustrates  a  use  of  classes  of  terminal  symbols.  The  symbol 
DIRN  is  a  member  of  the  constant  class  {DIRN,  EAST,  WEST}.  Therefore,  the 
last  line  in  the  proof  is  a  specification  of  the  goal  state  DATA.IM.DIRN  , 
but  is  not  Identical  to  it. 

9.7  Inequalities:  The  final  example  is  the  solution  of  introductory 
problem  in  the  calculus  of  inequalities.  Inequalities  present  an  Interesting 
area  of  mathematics  in  which  to  study  theorem  proving,  since  inequalities 
proofs  frequently  depend  upon  combinations  of  arguments  from  algebra  and 
from  mathematical  logic.  Therefore,  in  order  to  do  inequalities  the  program 
must  have  available  rewriting  rules  from  the  more  basic  fields.  Typically 
only  a  few  rules  will  be  used  in  any  one  proof,  but  since  their  identity 
cannot  be  known  before  starting  on  a  problem,  all  must  be  available.  The 
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presence  „f  many  rules  will  greatly  increase  the  probability  of  the  orogran's 
starting  down  fruitless  paths  Tnis  ccttsideration  applies  to  both  state  to 
state  theorem  p rovers  and  to  the  resolution  principle  j.»o grams  (15).  There¬ 
fore,  inequalities  provide  tests  of  the  extent  to  which  the  generation  of 
difference  sets  will  orovide  a  framework  to  test  the  -electivity  of  the 
program. 

Ia  this  examnle  the  FDS  program  used  the  simple  ordering  procedure 
of  determining  the  probable  usefulness  of  a  rewriting  rule  bv  a  weighted  sum 
of  (a)  the  number  of  conditions  on  the  string  required  bv  the.  rewriting  rule, 
i.e.,  the  complexity  of  the  left  hand  side,  and  (b)  the  number  of  these 
conditions  satisfied  by  the  current  state  string.  The  system  was  Initialized 
by  loading  rewriting  rules  based  on  algebra  and  the  prepositional  calculus, 
including  definitions  of  "implies",  "conjunction",  and  "equivalance" ,  and 
the  axioms  defining  permissible  algebraic  manipulations  with  +,  /,  and  x  . 

Ir.  addition,  suout  one  hundred  previous lv  proved  theorems  in  both  areas  were 
loaded  as  rewriting  rules.  Tab) ■l  5  lists  the  definitions  of  inequalities 
and  the  theorems  proven. 

The  proof  of  the  following  theorem  is  illustrative.  It  was 
obtained  at  a  time  at  which  the  s vs ter  had  to  select  rewritings  from  a  set 
of  134  rules.  The  problem  is  to  show  that 

REAL  (A)  -  REAL  (ft)  ( (A  >  P)  ~  (A  -  !$))  ~  (ft  *  \) 
is  a  legal  rewriting.  The  proof  is 

REAL  (A)  •  REAL  (3>  RIAL  (A  -  R) 


r:  ai.  i 
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The  proof  was  produced  in  two  minutes  and  thirty  three  seconds. 
Twenty  three  structures  were  considered  and  six  used  in  the  proof.  Most  of 
the  time  was  spent  establishing  the  order  in  which  operators  were  to  be 
applied.  As  can  be  seen,  a  good  ordering  was  achieved. 

9.8  Summary  of  the  examples;  These  examples  have  been  taken  from 
about  one  thousand  theorem  proving  problems  which  have  been  solved  by 
different  programs  fitting  within  the  framework  of  the  FDS  algorithm.  The 
performance  of  a  particular  program  on  a  given  problem  will  depend  upon  the 
parameters  used  to  limit  its  search  and  upon  the  rule  which  it  uses  to 
determine  the  sequence  in  which  operators  will  be  tried.  The  programs  are 
relatively  insensitive  to  parameter  changes,  but  highly  sensitive  to  the 
effect  of  different  ordering  rules.  An  interesting  question,  which  we  are 
now  exploring,  is  whether  or  not  it  is  possible  to  write  a  program  which 
develops  its  own  ordering  rules. 

The  FDS  algorithm  has  not  produced  any  proofs  of  theorems  which 
would  be  considered  "deep"  by  a  pure  mathematician.  On  the  other  hand,  it 
more  than  holds  its  own  With  upper  division  undergraduates,  providing 
that  the  proofs  which  it  is  trying  to  discover  have  the  line  by  line  property. 
This  is  no  mean  accomplishment,  given  the  current  state  of  artificial 
intelligence  research.  It  seems  fair  to  sav  that  FDS  orograms  prove  theorems 
as  well  as  the  better  currently  available  chess-playing  programs  play  chess, 
(3),  but  that  it  does  not  prove  theorems  as  well  as  checkers  playing  programs 
play  checkers  (11) . 


1 0 «  Comparison s  an u  Con clus i ons: 

10.1  mpcrison  to  CPS:  As  we  have  indicated,  tlie  ?DS  is  an 
intellectual  descendant  or  the  GPS.  '7,8).  Both  proprams  rtc  theorem  p rovers 
which  solve  problems  by  successive  revu i tings ,  from  a  starting  state  to  a 


state. 


Tire  re  are  two  najov  <11 .  Terences  !>t  tween  the  CPS  and  FDS  proprams. 
The  most  obvious ,  and  rooai.  irivldl ,  is  hat  the  CPS  is  a  list  processing 
j.  ogram  written  in  ii-’L-V,  while  FDS  r  o grams  are  written  in  FORTRAN  vjithout 
the  use  of  embedded  list  processing  features .  Tills  is  solalv  a  technological 
advance,  as  undoubtedly  the  GT'o  could  be  duplicated  in  this  way.  Having  a 
machine  efficient  program  h-’s  permitted  us  to  study  program  performance  o\  -r 
a  much  wider  range  of  problems  than  would  have  been  the  case  had  we  used  an 
interpretive  language. 

The  snore  interesting  difference  is  ir,  how  the  programs  define 
differences  between  states  and  use  them  to  select  operators,  ‘ilia  OPS  user 
must  provide  a  table  called  the  "Operator-dif ference  table",  and  a  set  of 
subroutines  representing  cratora  and  differences.  These  define  the 
differences  which  the  program  can  notice  and  the  rewri Ling  rules  to  be 


considered  in  reducing  each  difference.  The  FDS ,  on  w  e  other  hand,  generates 
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its  own  equivalent  of  differences  and  operator-difference  tables  by  analysis 
of  rewriting  rules,  A  FDS  program,  will  not  generate  all  the  "differences1' 
which  a  human  night  see  between  two  states,  as  we  showed  in  g-ction  8,  On 
the  other  hand,  FDS  provides  a  completely  algorithmic  theorem  proving 
procedure  once  the  axiomatic  system  has  been  defined  to  the  program,  while 
in  GPS  there  is  one  more  step  at  which  human  ingenuity  or  lack  of  if,  can 
intervene,  (6),  The  question  "Uhl eh  theorem  prove r  is  better?"  is  an 
unanswerable  one,  since  the  two  procedures  make  a  different  division  of  .labor 
between  man  and  computer  on  the  theorem  proving  tack. 

The  later  versions  of  CPS  (1,2)  have  Introduced  a  new  sort  of  goal. 
Select  the.  element  of  the  set  S  which  best  fulfills  criterion  C  This 
method  of  defining  a  goal  is  quite  different  from  the  definitions  used  ir. 

FDS,  as  "best"  implies  an  ordering  of  objects  on  the  basis  of  their  relative 
possession  of  some  property.  There  is  no  wav  of  representing  such  a  goal 
in  the  FDS  structure.  It  appears  from  the  examples  ^iven  in  (2)  that  this 
goal  is  quite  useful,  on  some  problems,  but  that  these  problems  are  some¬ 
what  outside  the  field  of  theorem  proving. 

10.2  The  resolution  principle:  The  Resolution  Principle  (10)  is 
a  quite  different,  and  very  powerful,  approach  to  theorem  proving.  There 
are  three  steps  in  using  this  principle.  First,  one  must  represent  the 
relevant  area  of  mathematics  as  a  set  of  clauses  in  the  first  order  nredicate 
calculus  in  disjunctive  normal  form,  i.e.  as  a  set  of  statements  of  the 
form  (A  or  B  or  Not(C))  .  In  addition  to  representing  the  premises  of  a 
theorem  this  way,  the  negation  of  the  conclusion  is  als  so  represented. 

Using  the  single  rule  of  inference  that  if  (A  or  not  (B))  and  (B  or  C) 


are  true,  then  the  clause  (A  o r  C)  may  be  inferred,  a  resolution  principle 
program  attempts  to  prove  that  the  negation  of  the  conclusion  is  inconsistent 
with  the  premises. 

Tills  technique  is  very  veil  suited  to  the  discovery  of  proofs  which 
do  not  have  the  line-by-line  property,  "c  have  already  shown  that  this  is 
precisely  the  point  at  which  the  FDS  does  poorly,  '-'e  suspect  that  there  are 
situations  in  which  the  converse  i-.  true.  One  of  the  problems  with  the 
resolution  principle  method  of  theorem  proving  13  that  the  number  of  inferred 
clauses  multiplies  rapidly.  A  variety  of  strategies  have  been  suggested  for 
correcting  this  problem,  and  some  have  had  notable  success  (13.  15).  Still, 
we  suspect  that  it  will  remain  a  problem.  This  is  particularly  so  if  the 
basic  axioms  of  the  system  in  which  one  is  working  are  such  that  they  are 
clumsy  to  state  in  the  first  order  predicate  calculus.  I'e  offer  the  Sanderson 
algebra  as  an  example  of  such  a  system.  Based  or  these  considerations,  we 
offer  the  following  conjecture,  in  the  hopes  that  evidence  will  soon  be 
published. 

"If  proofs  in  an  area  of  mathematics  typically  depend  upon  inferences 
from  a  large  number  of  previously  proven  theorems  or  axioms,  and  if  these 
proofs  are  likely  to  display  the  line-by-line  property,  the  state-to-goal 
method  of  theorem  proving,  as  exhibited  by  FDS  or  GPS,  will  be  more  practical. 
To  the  extent  that  proofs  denend  upon  the  convergence  of  several  lines  of 
reasoning,  and  can  be  obtained  by  reference  to  a  relatively  small  number  of 
previously  stated  results,  the  resolution  principle  will  be  the  more  practical 
technique  of  theorem  proving." 
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Another  contrast  between  tue  FDS  algorithm  and  the  resolution 
principle  raises  quite  anorher  question.  The  resolution  principle  tends  to 
produce  proofs  which  are  certainly  valid,  (i.e,,  their  validity  is  provable), 
but  which  are  hard  or  inpossible  for  a  person  to  comprehend .  Line-by-line 
proofs  are  easy  to  follow.  Is  this  a  real  question?  Robinson  (10)  correctly 
states  that  a  theorem  is  oroven  if  it  is  algorithmically  decideable  that 
its  proof  is  correct,  regardless  of  v;ho  cormrehends  the  proof.  In  some  cases, 
however,  the  point  of  obtaining  the  proof  is  not  to  make  the  assertion  but  to 
understand  the  reasoning  which  lends  to  it.  If  this  is  the  case,  the  proof 
must  be  intelligible. 

10.3  Summary :  A  procedure  for  mechanical  problem  solving  has 
been  presented.  Computer  programs  based  upon  this  method  have  proven  a  large 
number  of  simple  theorems,  and  appear  to  be  able  to  operate  at  the  level  of 
a  university  undergraduate  mathematics  student.  Illustrations  of  solutions 
were  given,  and  the  method  contrasted  to  that  of  the  General  Problem  Solver 
and  the  Resolution  Principle. 
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2.  The  exact  correspondence  is  difficult  to  establish,  since  insofar  as 

we  know,  no  rigorous  definition  of  the  algorithms  of  the  General  Problem 
Solve;,  have  ever  been  published.  The  earlier  informal  descriptions 
of  GPS  (7,8)  indicate  that  the  program  may  have  used  the  recursive 
method  of  problem  generation  defined  in  section  7.n.  A  later 
paper  (11)  and  technical  report  (12)  suggest  that  the  final  version 
of  GPS  used  something  much  like  the  improved,  non-recursive  procedure 
of  seccion  7.5. 
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